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We investigate the production of beyond-the-standard-model color-sextet vector bosons at the 
Large Hadron Collider and their decay into a pair of same-sign top quarks. We demonstrate that 
the energy of the charged lepton from the top quark semi-leptonic decay serves as a good measure 
of the top-quark polarization, which, in turn determines the quantum numbers of the boson and 
distinguishes vector bosons from scalars. 
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Introduction - The cross section for production of 
top quarks is relatively high at the energies of the Large 
Hadron Collider (LHC). While conventional mechanisms 
produce either a single top-quark or a top-antitop pair, 
it is important to be alert to the observation of a pair of 
same-sign top quarks. One consequence would be the ap- 
pearance of a pair of same-sign leptons with large trans- 
verse momentum. In a recent paper, we explore the po- 
tential for discovery of an exotic color-sextet scalar in the 
production of a pair of same-sign top-quarks in early runs 
of the LHC at 7 TeV 0. The standard model (SM) back- 
grounds are small. We demonstrate that one can mea- 
sure the scalar mass and the top-quark polarization, and 
confirm the scalar nature of the resonance with lfb _1 of 
integrated luminosity. Moreover, the top-quark polariza- 
tion distinguishes gauge triplet- and singlet-scalars. In 
the present manuscript, we address color sextet vector 
production in same-sign top-quark pair-production, and 
we show that its discovery, and the determination of its 
properties, could also be accomplished with early LHC 
data. 

Important in our analysis is the recognition that among 
the products of semi-leptonic top-quark decay, the direc- 
tion of the charged-lepton is highly correlated with the 
top-quark spin. The top-quark polarization can be mea- 
sured from the distribution in cos 9 [2j , the cosine of helic- 
ity angle between the charged-lepton momentum in the 
top-quark rest frame and the top-quark momentum in 
the center-of-mass frame of the production process (i.e. 
the rest frame of the parent scalar or vector). Gauge 
triplet scalars decay to tiX^, and gauge singlet scalars 
to tutu. Here, tt and tu denotes top quarks with left- 
handed and right-handed polarization. In either case, 
both top quarks produce the same angular distribution, 
either (1 - cos6»)/2 {t L t L )oi (1 + cos#)/2 (t R t R ), allow- 
ing unambiguous identification of the scalar A color 
sextet vector decays into a t^R pair. In this case, the 
observed inclusive angular distribution in the final state 
would be a flat, a sum of the shapes from the ti, and 
the tn decays. The flat profile would distinguish a vector 
from a scalar, but it also would admit a mechanism that 
yields unpolarized top quarks. 

In this paper we establish that one can separate the 



angular distributions corresponding to tr, and tn from 
the color sextet vector decay into a t r,tR pair. The solu- 
tion relies of the introduction of asymmetric cuts on the 
momenta of the leptons from the top-quark decays. 

The Model - The most general SU(3) C x SU{2) L x 
U(l)y effective invariant Lagrangian for color sextet 
scalars $ and vectors has the form [H-IH 

£ = {9iLqliT 2 qL +9iRU c R d R ) $ 6 , M / 3 
+ 9iRd c R d R $ 6A ^ 2 / 3 + gi R u R u R $ 6:1A/3 

+ g3Lq C L iT 2 Tq L ■ $6,3,1/3 

+ 92qll^d R y^. 2 _ 1/6 + g' 2 ~qil^ R V£ 2 b/6 + h.c. , (1) 

where = (uL,dr,) denotes the left-handed quark dou- 
blet, ur and d R are the corresponding right-handed 
gauge singlet fields, and q c = Cq T is the charge con- 
jugated quark field. For the sake of simplicity, color and 
generation indices are omitted. The subscripts on the <E> 
and V fields denote the standard model gauge quantum 
numbers {SU(3) C , SU{2) L , U{l) Y ) 1 • 

We are interested in same-sign top-quark pair produc- 
tion via a sextet vector decay. Only the axial- vector part 
of the coupling contributes while the pure vector cou- 
pling vanishes due to the identical quarks. The effective 
coupling of the color sextet vector to a pair of identical 
quarks (qq) is 
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£int = fiC^ a7M75% C V^+h.C. 



(2) 



where the KM are Clebsch-Gordan coefficients; a and b 
are the color indices in the fundamental representation; 
M is the color index in the sextet representation; and 
g is the coupling strength. Without loss of generality, 
we concentrate on real and flavor-conserving couplings 
in this work. 

The coupling of the vector to two up-type quarks is 
largely constrained by the measurement of D° — D° mix- 



1 The vector Vg 2, — 1/6 ls n °t considered here as it cannot decay 
into a top-quark pair. Its collider phenomenology will be pre- 
sented elsewhere 
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ing which is affected by the vector at the tree level. The 
AC = 2 1 Hamiltonian induced by V is 



H A 



C=2 



(3) 



The four-fermion operators Q 2 and Q 3 are 

Q2 = (uLa^CLa) {uRfil fiCRfj) , (4) 
Q3 = {uLaCRa) {uRfiCLp) , (5) 

and the Wilson coefficients are 

C 2 (m v ) = -1, C 3 (m v )=2. 
The vector's contribution to Amo = |m,£>o — m D° \ ^ s 




C 2 (Q2) + C 3 (Q 3 ) 



m D my 

where the hadron matrix elements are 0] 



(6) 



(Q 2 > = -lf D m 2 D B D , {Q 3 ) = ^f D m 2 D B L> . (.7) 



with / D = 222.6 ± 16.7Z z 2 l MeV > m ^ = 1865 MeV, 
and Br> = 0.82 [8|. To be consistent with the measured 
Amu 



xd = 



Ami) 



8 x 1CT 3 , T D = 1.6 x 10" 12 GeV, 



the coupling g qq is stringently constrained: 

9uu9cc < 1-6 x fO- 8 (8) 

for my ~ 1 TeV, after an enhancement factor ~ 2.f is 
included from the QCD running of the Wilson coefficients 
from the scale my to m c . 

This strong constraint on the product g U u9cc allows 
freedom for the production of V at the LHC if the cou- 
pling g cc to the second generation quarks is minimized. 
Alternatively, the first generation may be suppressed 
while the second generation is not, but such sea-quark 
initiated processes are relatively suppressed. 

For the choice g = 1, we show the cross section for 
V production via the process uu — > V at the LHC in 
Fig. 03a) and the tt cross section via the process uu — > tt 
in Fig. [TJb) . The large cross sections arise from the large 
parton distribution functions for valence u quarks in the 
initial state. If the LHC energy is raised from 7 TeV to 
14 TeV the cross section is increased by roughly a factor 
of 3 to 4. 

Discovery Potential - We focus on the same sign 
dilepton decay mode in which the W bosons from both 
t — > Wb decays lead to a final state containing an elec- 
tron or muon, W — > lv, accounting for about 5% of all tt 



%10 4 



uu^v (a) 




400 600 800 10001200140016001800 

m v (GeV) 



■Q 

A 3 
^=10 3 



uu^V^tt (b) 




400 600 800 10001200140016001800 

m v (GeV) 

FIG. 1: Leading order cross sections (pb) for (a) V production 
via uu — y V and (b) like-sign t-pair production via uu — > V — > 
tt at LHC energies: 7 TeV (solid), 10 TeV (blue dashed), and 
14 TeV (red dashed) for g = 1. We use the CTEQ6L parton 
distribution functions [l(| and choose the renormalization and 
factorization scales as my- 



decays. We concentrate on the clean final state be- 

cause muon reconstruction has a large average efficiency 
of 95 — 99% within the pseudorapidity range \-q\ < 2.4 
and transverse momentum range 5 GeV < px < 1 TeV, 
while the charge mis-assigned fraction for muons with 
p T = 100 GeV is less than 0.1% [n|. 

These events are characterized by two high-energy 
same-sign leptons, two jets from the hadronization of 
the 6-quarks, and large missing energy from two 

unobserved neutrinos. We g enerate the dominant back- 
grounds with ALPGEN HJ: 

pp W + {-+ £ + v)W + {-^ i + v)jj, (9) 
pp tt^bW + {^£ + is)b(^e + )W~{^ jj). (10) 
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TABLE I: Signal and background cross sections (pb) before and after cuts, with g = 1, for six values of my (GeV). The decay 
branching ratios of the signal Br(tt) are given in the second column. The "no cut" rates correspond to all lepton and quark 
decay modes of W-bosons, whereas those "with cut" are obtained after all cuts, the restriction to 2 fi +, s and with tagging 
efficiencies included. 



rn v Br (tt) No cut With cut 


m v Br(tt) No cut With cut 


Background No cut With cut 


500 0.446 10.97 1.71 
600 0.466 8.22 1.76 
700 0.477 5.89 1.53 


800 0.483 4.22 1.21 
900 0.487 3.02 0.92 
1000 0.489 2.22 0.70 


tt 97.62 0.0004 
WWjj 9.38 0.00001 
WWW/Z 0.03 0.0006 



The first process (WWjj) is the SM irreducible back- 
ground while the second (ti) is a reducible background 
as it contributes when some tagged particles escape de- 
tection, carrying small pr or falling out of the detector 
rapidity coverage. For example, one of the 6-quarks de- 
cays into an isolated charged lepton while one of the two 
jets from the W~ boson decay is mis-tagged as a 6-jet. 
Other SM backgrounds, e.g. triple gauge boson produc- 
tion (WWW, ZWW, and WZg(-^ bb)), occur at a neg- 
ligible rate after kinematic cuts, and are not shown here. 

At the analysis level, all signal and background events 
are required to pass the following acceptance cuts: 

p 3 T >50GeV, \r)j\< 2.5 

> 50 GeV, p^™ > 20 GeV, \r/ e \ < 2.0, 
AR jjjm > 0.4, (11) 

where we order the two charged leptons in the final state 
by their energies and label the more energetic lepton as 
"greater" and the other one as "lesser". Owing to spin 
correlations, the charged lepton from right-handed top 
quark decay is more energetic than the one from the 
left-handed top quark decay. This difference motivates 
our asymmetric cut on the px of the two charged lep- 
tons. The separation AR in the azimuthal angle (4>)- 
pseudorapidity (77) plane between the objects k and I is 



V '(m - mf + S ~ '■ (12) 



ARm = 



We model detector resolution effects by smearing the final 
state energy according to 
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A 



E y/E/GeV 



B. 



(13) 



where we take A = 10(50)% and B = 0.7(3)% for 
lcptons(jets). To account for 6-jet tagging efficiencies, 
we demand two 6-tagged jets, each with a tagging ef- 
ficiency of 60%. We also apply a mistagging rate for 
charm-quarks e c ^b — 10% for pr(c) > 50 GeV. The 
mistag rate for a light jet is £ u .d,s.g^b = 0.67% for 
p T (j) < 100 GeV and 2% for p T (j) > 250 GeV. For 
100 GeV < pr (j) < 250 GeV, we linearly interpolate the 
fake rates given above. 

After lepton and jet reconstruction, we demand that 
the two hard leptons are of the same sign, a requirement 
which greatly reduces the SM background, giving a re- 
jection of order 10 -4 and 10 -3 for the ti and WWjj 



processes, respectively. After the cuts are imposed, we 
find a total of 1.0 background event, 0.4 from ti and 0.6 
from WWjj for 1 fb _1 of integrated luminosity. 

After 6-tagging and restriction to the mode, 15- 

30% the signal events survive the analysis cuts depending 
on the vector mass. Signal and background cross sections 
are shown in Table HI before and after cuts, for 6 values 
of my. 

Because the decay width of V is narrow, 



T(V -> qq) 



g 2 mv 
24tt 



1 - 



4m^ 



3/2 



(14) 



one can factor the process uu —> tt into vector production 
and decay terms, 



a(uu -> V ^ tt) = a (uu V) x g 2 Br(tt), 



gq(uu — > V — > tt) x g 



2 Br(tt) 
Br (tt)" 



(15) 



The decay branching ratio Br(tt) = Br(V — > tt) is 



Br(tt) 



9uR 



Q 2 



9itR 



R= (1 -4m?/m^) 3/2 . (16) 



Subscript "0" denotes the reference value g = 1. We 
choose to work with the following two parameters in the 
rest of this paper: the vector mass my and the product 
g 2 Br(V tt). The kinematics of the final state particles 
are determined by the vector mass, whereas the couplings 
of the vector to the light and heavy fermions change the 
overall normalization. 

In Fig. [21 we show the expected numbers of signal 
events as a function of my for a range of values of the 
coupling g 2 Br(V — > tt). We obtain the event rate lines by 
converting the required cross section into g 2 Bi(V — > tt) 
via Eq. [TS1 Based on Poisson statistics, one needs 8 sig- 
nal events in order to claim a 5er discovery significance 
(equivalent to a 99.999943% confidence level) on top of 1 
background event. We plot the 5cr discovery line (solid) 
in the figure. Rates for other values of g uu and g u can 
be obtained from Eq. [T5l 

The search for same-sign top quark pair production 
in the dilepton mode at the Tevatron imposes an up- 
per limit <j(tt + tt) < 0.7 pb [l3T - fl5j| , The constraint is 
plotted in the orange shaded region. The CDF collab- 
oration measured the ti invariant mass spectrum in the 
semi-leptonic decay mode [l6j . Since b and b jets from 
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FIG. 2: Event number contours as a function of the vector 
mass and the parameter g 2 Hr(V —>■ tt) after all cuts with 
an integrated luminosity of 1 fb -1 . The shaded regions are 
excluded, as explained in the text. 



m v = 500 GeV 
m v = 700 GeV 
my = 1000 GeV 




FIG. 3: Normalized distributions of the energy of the charged 
lepton from top-quark decay for mv = 500, 700, 1000 GeV. 
The solid lines correspond to the left-handed top-quark decay 
while the dashed lines to the right-handed top-quark decay. 



t — > Wb are not distinguished well, tt pairs lead to the 
same signature as tt in the semi-leptonic mode. Hence, 
the m t t spectrum provides an upper limit on a(tt + tt), 
shown in the cyan shaded region in Fig. [2] The lower gray 
shaded region is the region in which V would hadronize 
before decay, washing out the spin correlation effects we 
utilize to probe the coupling and spin of the sextet state. 

Top Quark Polarization - We use the observation 
of a pair of same sign dileptons as indicative of a same 
sign top quark pair and to suppress SM backgrounds ef- 
ficiently. The two missing neutrinos in the final state 
complicate event reconstruction. Following Ref. [l|, we 
use the MT2 method to select the correct b-fi combina- 
tions and to verify whether the final state is consistent 
with t — > Wb parentage. Then we make use of the on- 
shell conditions of the two W bosons and two top quarks 
to solve for the neutrino momenta [13, [H| • Once the neu- 
trino momenta are known, the kinematics of the entire 
final state is fixed, and the vector boson mass is com- 
puted from the invariant mass of the two reconstructed 
top quarks. 

The next step is to verify that the top-quarks exhibit 
opposite polarization, accomplished here by making use 
of the difference in the momentum spectra of decay lep - 
tons from left-handed and right-handed top quarks [19j . 
The energy of a charged lepton in a right-handed top- 
quark decay is harder than the one in a left-handed top- 
quark decay. The differential distribution in the energy 
of the charged lepton energy is 



dx 



dz 



d{x'z') dT 



d(x, z) dx'dz' ' 



(17) 



where x = 2E(/E t is the energy fraction of the charged 



lepton, and z — cos 8 where 9 is the helicity angle defined 
in the Introduction. The variables x' and z' are defined 
in the top-quark rest frame and are linked to x and z in 
the laboratory frame through the top quark boost: 



x 1 = X7 2 (l - z/3), z' 



P 



1 - z/3' 



(18) 



where 7 = E t /m t and j3 = y/l — I/7 2 . The lower and 
upper limits of integration are 



Max 
Min 



1 



2 

7 x 

B 

2 

72; 



1 



(19) 
(20) 



The differential cross section dT /dx'dz' in the rest frame 
of the top quark is [20( 



dT_ = c^rrH 



dx'dz' 32tt AB 
x ArcTan 



Ax' 



B-x' 

where A = Tw/mw, B — m^/m^, 



ArcTan(x) 



for x > 0, 



(21) 



arctan(x), 
7r + arctan(x), for x < 0, 



and St labels the top quark spin direction. Here, mw 
and Tw denote the mass and width of the W boson, 
respectively. 

In this work we choose the helicity basis to measure the 
top quark polarization. In this basis, the top quark spin 
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is chosen to be along (against) the direction of motion of 
the top quark in the center of mass frame of the system. 
After a boost from the top-quark rest frame to the lab- 
oratory frame, we obtain the energy distributions of the 
charged leptons from left-handed and right-handed top- 
quark decays shown in Fig. [3j The solid curves denote 
the ti, decay while the dashed curves the tu decay. As the 
charged lepton follows the top quark spin, the lepton from 
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FIG. 4: (a) Distribution in cos 8 for reconstructed top quarks 
from V — >• tRth without energy selection on the decay lep- 
tons. Both fi + leptons exhibit similar distributions, (b) Dis- 
tribution in cos (9 for the reconstructed ti essei (black-solid) 



tR decay tends to follow the direction of motion of the 
top-quark, and is more energetic. The lepton from the 
tjj decay tends to move against the direction of motion of 
its top quark, and it is therefore less energetic. The dif- 
ference in the energy spectra becomes more evident with 
increasing my- For example, for a 1000 GeV vector, the 
charged lepton from tfj decay peaks near x = 0.5 while 
the one from ti, decay peaks below x — 0.1. We note that 
both solid and dashed curves have a kink feature. For the 
left-handed top-quark decay, the kink arises largely from 
the boost, which generates the lower integration limit 
Zmin- The limit yields a scale of x ~ 1 — for a heavy 
vector. On the other hand, the kink in the distribution 
for right-handed top-quark decays comes mainly from the 
non-continuity of the ArcTan function in the matrix el- 
ement, which yields a scale of x ~ B (1 + 0) after the 
boost. 

In sextet vector boson decay into a tiXn pair, the 
charged leptons exhibit a mixture of the energetic and 
soft spectra. To utilize this feature, we order the energy 
of the leptons and define the top quark containing the 
greater energy lepton as t grca tcr and the other top quark 
as ticsscr- The cos 9 distributions of the reconstructed 
^lesser and tgreater are displayed in Fig. [4j These results 
show that one can differentiate the (1 + cos0) (tn) and 
(1 — cos#) (ti,) shapes. The reconstruction is not perfect, 
however, owing to imperfect assignment of the charged 
lepton. As shown in Fig. [3J charged leptons from 
decay can be more energetic than those from t# decay 
with small probability. With increasing vector mass, the 
probability of wrong assignment becomes smaller. 

As a consistency check on this method for determin- 
ing polarizations, we apply the same reconstruction to 
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FIG. 5: Distribution of cos# of the reconstructed tie 



and 



and tgrcater (red-dashed) . For illustration we choose m v = igrcatcr of a singlet scalar decay into tutu. For illustration we 
600 GeV. choose rn v = 600 GeV. 
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singlet scalar decay into two right-handed top-quarks. 
The reconstructed t\ csscr and £ gre ater distributions for sin- 
glet scalar decay are shown in Fig. [5] Both distributions 
maintain the expected (1 + cos 9) trend, but the shapes 
are distorted by event reconstruction. Hence, we gain 
added confidence that the top-quark polarization can be 
determined and used to discriminate vector bosons from 
scalar bosons. 

Summary - We present a study of the search for ex- 
otic charge 4/3 color-sextet vector bosons in the produc- 
tion of same-sign top-quark pairs at the LHC at 7 TeV. 
We examine the final states in which both top-quarks de- 
cay semi-leptonically. We show that vector bosons can be 
distinguished from scalars. The top quarks from vector 
decay exhibit opposite polarization, one left-handed and 
one right-handed. The inclusive distribution in the helic- 
ity angle cos 9 of a charged lepton is flat since it receives 
contributions from both top quarks. However, we show 
that an energy selection on the charged leptons can re- 



store the characteristic shapes that distinguish left- and 
right-handed top quarks. Correspondingly, we show that 
LHC data should allow one to observe V — > tnti, and 
distinguish vector from scalar decay. 
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